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PROOF OF SOME REMARKABLE RELATIONS IN THE 
METHOD OF LEAST SQUARES. 



BY CHAS. H. KUMMELL, ASSIST. U. S. LAKE SURVEY, DETROIT, MICH. 

I consider here the standard case in the method of least squares, treated 
for the case of equal weights in Analyst, Vol. Ill, page 165 etc. Suppos- 
ing now the observations of different weight, I will give a condensed view 
of all the formulas required for a complete solution of this problem. 
Let there be the linear obser ation equations: 

a 1 x+b l y+ +l 1 w—[i 1 = J 1} weight p x , (l a ) 

a 2 x+b 2 y+ +l 2 w—fx 2 = z/ 2 , " p 2 , (1 2 ) 



a m x+b m y+ +l m w—fi. m = J n) " p m . (J m ) 

From these, after applying the weights as stated, Analyst, Vol III, p. 
170, we obtain the normal equations : 

[pa 2 >-f [pa&>+ +{par\w— [pa//] = [paJ] = 0, (2 X ) 

[pablp + [p& 2 ]y + . . . . + [ p bl]w-[p fy] = [p M] = 0, (2 V ) 

[paJ>+[p«]y+ .... +[pP]w-[p^] = [pM] = 0. (2.) 
These equations give the unknown quantities x, y, ... w in terms of 
[pafi], [.pbfi], • • ■ \_pl/i\- To obtain the minimum sum of squares of the 
corrections we may use the formula: 

[p/F] = — [p/izfj = — [pap]x— [pbfi~]y— . . .— [p^>+[pjU 2 ], (3) 
or since it is desirable to know the corrections J lt J 2 > • • • d m , themselves, 
we may compute them by (1) and form [p^ 2 ]. 

Since x,y,...w must be linear functions of /i 1} /Jt. 2 ,...fi m we may assume 

> * = [«/*]» y = \-Pp1, . . • » = l>]- (4) 

These forms being introduced into the normal equations, these latter may 
be resolved into the following equations, since fi 1} ft 2 , . . ft m are independent, 

[p« 2 >i +[pa&]Pi + • • • +[pal]k 1 —p 1 a 1 = 0, (5 fcl ) 

[pa 2 ]« 2 -|-[pa&]i9 2 + . . . +[paQX a —p a a 2 = 0, (6,. a ) 



[pa 2 ]« m + [pab~]p m + . . . +[pal]A n —p m a m = 0, (5 x . m ) 

tpab-]a 1 +[pb*-tf 1 + . . . +[pbqX l -p 1 b 1 = 0, (5 M ) 

[pa6]a 9 +[p6»]/9 a + . . . +[p6/]A 2 - i > 2 6 2 = 0, (5, 2 ) 

[pa6]a m +[p6 2 ]/9 m 4- . . . +[_pbl~]k m —p m b m = 0, (5„. m ) 
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oo«i+[>m]£i+ ••■ +ii**yi-pih = °> ( 5 ».i) 

[pal]a. z +[pbl]^ + . .. +[p* 2 ]A 2 -p 2 Z 2 = 0, (5„. a ) 

[paZ]a„-r[p6/]^ m + . . . +[pP]X m — pj m = 0, (5,„. m ) 
Summing products by a lt a 2 , . . . a„, then for each of the n sets we see 
that we must have 

[aa] = 1 ; [a£] = 0; [«A] = 0; (6 X ) 

[6a] = 0; [6/3] = 1; [6A] = ; (6,) 



pa] = 0; [7/9] = 0; . . . . [IX] = 1. (6„) 
We have then, using equations (5) for forming these aggregates, 

[aa] = [pa2][«2-p]+[p«6][a^H-p]+ . . . + [pal]laX+p] = 1, (7*.«) 

[6«] = |>a6][«*-p]+[p62][«/3-p] + . . . + [ pb l][aX+p] = 0, (7 y . a ) 

[la] = [parj[a2-^p]+[p6/][« i 9^-p]+ . . . + [p/ 2 ][a,l-p] = 0, (7„, a ) 
[a/3] = [pa*][a i 3+p] + [pab][p*+p] + . . . + [pal][£X+p] = 0, (7,./?) 
[6/3] = [pa6] [«^ p ] + [p62][^2^ p]+ . . . + [pbl][pX+p] = 1, (7^) 

p/3] = [paZ][«/3^p]+[p6f|[/3^p] + . . . + [i>P][j3X+p] = 0, (7 w ./j) 

[aX] = [pa*] [«^p] + [pa6] [/3A-p] + . . . +[ P al] [X*+p] = 0, (7*.*) 
[bX] = [pa6] [«A+p]+[p62] [0X+p]+ • • • +[p^] [**+P] = 0, (7^) 

[U] - [paf] [«>t-Hp] + [pW] D^H • • • +[P' 2 ] [>* 2 -i>] = I- (7**) 
Multiplying the normal equations in their order by the quantities [a 2 -t-p], 

[a/3-s-p], [ a ^~=~p] which result from these equations and adding the 

products we obtain 

a? = lap.] = [a2--p] [pap] + [ap+p] [pbp] + . . . + [aX+p] [pip], (8 X ) 
Similarly we obtain 

y = W\=* W+p] [p^]+[^ 2 -^] [pbp]+ • • • +W+p] [pip], (8„) 

w = lift] = [aX+p] [pap] +[fil+p] [pbp] + ... +[P+p] [pip]. (8„) 
These equations would have resulted as normal equations from the follow- 
ing equations as observation equations: 



^l[pap] +&[W] + • • • +^-[plp']-p 1 = J u w't, Pl , (9 X ) 
^\jap~\ +|*[W] + • • • + ? ^[p^]-^2 = 4, " P 2 , (9.) 



-86- 



t M + feL>] + • • • + ^0] -'*■ = J - ^ *~ (9 "> 

by making [p^ 2 ] = a minimum. 

Resolving equations (8) we obtain the following formula? analogous to (5) ; 

«i = [« 2 ^P]Pi«i+[«/5^-p]Piti+ • • • +[«^-5-p]Pi«i, (10,.!) 



& = [«^P]Pi«i+D5 2 -p]p 1 6 1 + . . . +m-*T]Pih, (10,.!) 
; n = [a^-^p]p 1 a 1 +|^^p]p 1 6 1 + . . . +[.P-*V]Pih> (10„.i) 

Let r — probable error of an observation, weight 1, then (r-s- yp) — the 
probable error of an observation, weight p, and applying the well known 
theorem [(43'), Analyst, Vol. Ill, p. 140] we have the probable errors 
of the unknown quantities 

and their reciprocal weights 

i-r4 i=rq ; ...JL = ri!i. (12) 

p x LpJ p„ LpJ p K LpJ v/ 

To obtain the probable error of p.j +J U [i 2 -\-J 2 , . . . viz., the observed 
quantities, corrected, we can use either (1) or (9). By (1) we have, using (4), 
Pi+^i = ai[«P]+&i[/?P]+ • • • +hW\ 
= K«i +bj x + ... +Mi)/«i 
+ (aj« 2 +&i/? 2 + . . . + l t ^)ft 2 
+ 

+ (OlOm WlPm + • • • +M-K.. 

Denoting the probable error of /<j -f J x by R 1 we have 
ijf = <J a*la'*+p]+a 1 b 1 lap+p-]+ . . . +Oi/ 1 [oi-^p] 
+a 1 b 1 [ap+p-]+bl [/? 2 -p] + . . . +b l l 1 [fiX+p] 

+ 

+ 0l Zi [«A-f-p]+6i ^[/9^p]+ . . . + *?[*'+P] J-r 2 
= (a 1 « 1 +6 1 ^ ] + . . . +i 1 ^ 1 ) (r^-s-Pi), by virtue of (10), (13) 
and the reciprocal weight 

^ = ^^1+^1+ • • • +Mi). (14) 

Likewise we have the expression for the correction J x , by (1), 

^i = ~Pi+«i[«p]+iiD3p]+ • • • +*iM 

= (— 1 + a 1 « 1 +6 1 j9 1 + . • • +MiK 
+(a x a 2 +6i^ 2 + . . . -Ki^)p 2 

+ 

+ (oia»+6i/5»+ • • • +MmK,- 
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Denoting the probable error of J 1 by p 1 we have 

P\= [1-2K*! +bj 1 + ... +l x XJ\ (r 2 - Pl )+i?f 

= (r*+ Vl )-R\ , by (13), = r\-B\, (15) 

or r\=R\+p\, (16) 

and 1-^-pj = l-f-P 1 + l-=-^ 1 , if ^ x denotes the weight of J x ; (17) 

hence the remarkable theorem : 

The probable error of an observed quantity is the hypothenuse of a right 
angled triangle of which the probable error of the corrected quantity and that 
of the correction are the sides. 

We have the weighted sum of equations like (13) 

[ P& ] = (M+IM1+ • • • +[«> 2 = nr\ by (6), (18) 
or \$-±-F\ = n. (19) 

Since [p-^-p] = ni we have the theorem : 

By the adjustment, the observed quantities are improved on the average in 
the ratio of n torn. 

We have also [p/> 2 ] = (m— m)r 2 , (20); [p^-;r] = m — n. (21) 

We can place [pe 2 '] = [pJ 2 ] where e lf e 2 , . . . e m are the mean errors of 
the corrections, but [p/v 2 ] = 2p 2 [ps 2 ] where p = 0.47694, the probable er- 
ror for absolute precision, = 1. We have therefore from (20) the formula 

also the average probable error for an observed quantity 

r =rV(m+[pY), (23; 

and that of a corrected quantity B Q = r y'(n -^[p] ). (24) 

If it is required to find the probable error of 

TJ= M+Ax+By+ . . . +Lw, (25) 

we have, in terms of fi x , p 2 , . . . p m , 

U= M+(Aa, +Bp t + . . . +U 1 )y. 1 
+(Aa 2 +B^ + ... +LX 3 )ft 9 

+ 

+ (Aa m +Bp m + . . . +U m )fi m ; 
. • . r,? = {A' [a»-s-p]+ii.B[a0-s-p] + . . . +4Z[aJ+p] 
+ AB\o.p+p-]+B* [j8»-f-p]+ • • • + BLtfX*-p] 

+ 

+^X[«A-fp]+j5X[/?An-p]+ . . . +L*lP-i-p] }r\ (26) 
If U is not a linear function of x, y, . . . w we replace them by x a + Ax, 
y„-\-dy . . . w -\-Jw and have, by Taylor's theorem, 

U= U +JU=f(x,„ y„ . .w )+iljx+Vjy + . . . +*fjw, 
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which is of the form (25) and we have 

f dp rap, df dfraf] , ,df djrcd-] 

\ dx* L V -I dx'dy[_p J ^ ' " ' ^ dx' dw\_ p J 

df dfr«l I + df^ r^n # _ _ + df dfrgn 

dx'dy\_p J d# 2 LpJ dy'dw[_pj 



+ 



df dfrax-i dfdfr§ri + <M1PA~} l r >. ( 26') 



Continuation op the Note at p. 57 by the Editor.— Substituting 

for a its value t0 ^t, -f 1, also substituting for J? its value, m-^, from (3), 
5.r D 

aud writing A for a^s-v 2 , we have 

= H. —?L U^ Dh \ C d 9_ - 

r f r\\ 5 I J V{j;R-Dh+L—cossf)' 

or, substituting for cos <p its equivalent, 1 — 2 sin*^, dividing the quantity 
under the second radical by \RDh, placing this divisor in the denominator 
of the first radical and writing <p for \tp and c 2 for 10-+-RDh, we get 



8 -*.-*{- - U ± 

r r J . 



r r J V0- + e 2 sinV) 

From (3) we have 

a Jx Ji . 
(f = If (01, 



r r 



. , _ 2 r d<p m 

• a, J V(l+c'sinV)" K ! 

Substituting for sin 1 ^ its equivalent 1 — cos 2 ^, dividing the quantity 
under the radical by 1+c 2 , and writing e 2 for c 2 -4-(l+c 2 ) we have 

. 2 f d<p , 9 v 

a>V(l+d 2 y V(l— e 2 cosY)' K ' 

The foregoing was sent to Mr. Charles H. Kummell, of the U. S. Lake 
Survey, with the request that he should calculate the numerical value of t; 
and, in response, Mr. Kummell has put the integral in the form 

* = ft *K (io) 

J i*-t Videos 2 V+bWV) 
which is more convenient for numerical calculation, and from which he finds 
t„ = 9 h 05 m 38 s .4. 
Hence it appears that the ball will pass a point 180° from the initial point, 
2 h 54 m 21".6 befor the point A will pass the same point in space. 



